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A  METHOD  FOR  ANALYZING  COMPETITIVE,  DUAL  SOURCE  PRODUCTION  PROGRAMS' 
Milton  A.  Margolis,  Raymond  G.  Bonesteele,  and  James  L.  Wilson, 


INTRODUCTION 


During  the  past  several  years,  program  managers  and  cost  analysts  within 
the  Department  of  Defense  have  been  asked  frequently  to  consider  the  cost 
effectiveness  of  dual  source,  competitive  procurement  strategies.  The  most 
common  solution  to  this  problem,  which  we  will  call  the  traditional  approach, 
requires  difficult  assumptions  about  the  behavior  of  the  second  source  during 
the  competitive  program.  This  paper  will  present  an  alternate  approach  which 
avoids  these  difficult  assumptions  concerning  the  second  source.  This 
alternative  approach  has  been  used  by  the  Office  of  the  Secretary  of  Defense 
(OSD)  Cost  Analysis  Improvement  Group  (CAIG)  for  independent  studies  of  dual 
sourcing.  First,  let's  look  at  the  traditional  approach. 

THE  TRADITIONAL  APPROACH 


The  traditional  analysis  of  dual  source,  competitive  procurement  breaks 
down  the  problem  into  four  steps: 

a.  Estimate  the  investment  and  production  costs  of  the  sole  source 

a  . 

supplier  through  the  remainder  of  the  program. 

b.  Estimate  the  investment  required  to  establish  the  dual  source 


production  capability. 


c.  Estimate  the  cost  of  production  by  the  original  source  operating 
In  a  dual  source,  competitive  environment. 

d.  Estimate  the  cost  of  production  by  the  second  competitor. 

The  most  common  solution  to  this  problem  compares  the  result  of  step  a. 
(sole  source  alternative)  with  the  sum  of  the  results  of  steps  b.,  c.,  d. 

(dual  source  alternative).  The  least  costly  of  these  alternatives  wins. 

Difficulties  arise  in  applying  the  traditional  approach  because  of  the 
assumptions  required  in  step  d  (estimating  the  cost  of  production  by  the 
second  competitor).  This  step  is  much  tougher  than  the  other  three.  One 
problem  is  that  the  identity  of  the  second  source  is  often  unknown.  Most  dual 
source  studies  ;ook  at  the  feasibility  of  dual  source  before  the  second  source 
contractor  is  identified.  In  this  case,  data  on  the  second  source 
contractor's  capability  and  experience  is  unavailable.  Another  difficulty  is 
forecasting  the  human  and  organizational  outlook  contributing  to  the  second 
source  contractor's  behavior.  How  eager  are  they?  How  much  of  their  own 
money  are  they  willing  to  invest  and  risk?  Are  they  willing  to  reduce  their 
engineering  or  other  staff  to  reduce  costs.  These  difficulties  cause 
uncertainty  in  the  results  of  step  d.  and  contribute  to  errors  in  the  final 
conclusion  drawn  from  the  traditional  approach.  An  approach  which  circumvents 
step  d.  would  obviously  be  most  useful. 

4  . 

THE  BREAK-EVEN  APPROACH 


This  section  will  describe  the  rationale  for  this  approach  and  the  next 
section  will  provide  a. method  for  implementing  it.  The  break-even  approach 


. , .  /  - 


develops  a  structure  for  deciding  if  competition  is  likely  to  be  successful  or 
not  without  requiring  step  d.  Steps  a,  b,  and  c,  are  calculated  and  a  value 
for  step  d  at  break-even  Is  the  result.  Here  “break-even"  means  the  total 
cost  remaining  for  the  sole  source  alternative  equals  the  total  cost  remaining 
for  the  dual  source  alternative.  This  can  be  expressed  by  the  following 
relationship. 

TCSS+  INVESTMENT^*  TCci  +  TCC2  +  INVESTMENT  (1) 

Where: 

TCSS  *  Total  recurring  cost  of  the  sole  source  supplier 

after  competition  begins. 

INVESTMENTss  3  The  remaining  investment  required  to  bring  the  sole 
source  to  full  production  rate  capacity. 

TCci  =  Total  recurring  cost  for  Competitor  1.  (Prime  Source). 

TCC2  3  Total  recurring  cost  for  Competitor  2.  (New  Second 

Source). 

t 

INVESTMENT  »  The  investment  required  to  establish  the  dual  source 


Because  this  type  of  problem  Is  one  which  requires  an  initial  investment 
to  achieve  savings  over  several  years,  the  break-even  calculations  should  be 
done  on  a  discounted  basis.  The  specifics  will  be  discussed  in  a  later 
section. 

Using  the  break-even  assumption,  relationship  (1)  becomes  an  equation. 
This  equation  can  then  be  solved  for  the  least  understood  term,  i.e.,  TCc2t  as 
shown  in  the  following  equation. 

TCc2  ■  TCSS  +  INVESTMENT  ss  -  TCci  -  INVESTMENT  c  (2) 

This  isolates  the  most  troublesome  term  as  the  dependent  variable.  TC^ 
represents  the  maximum  recurring  cost  the  government  could  permit  in  procuring 
units  from  the  second  source  in  order  to  break  even.  The  terms  on  the  right 
side  are  portrayed  in  Figures  1  and  2.  Each  of  the  terms  on  the  right  side 
can  be  calculated  and  combined  to  produce  a  value  for  TCC2*  It's  important  to 
note  that  TCC2  represents  deduced  cost  and  is  not  an  estimate  or  forecast  of 
cost. 


The  next  important  question  is  “How  Reasonable  Is  This  Deduced  Cost?“ 

The  best  way  to  answer  this  question  is  to  compare  the  deduced  cost  (TCC2) 

with  the  cost  from  the  sole  source  over  the  same  quantity  interval  on  the  cost 

*  .  » 

improvement  curve.  This  is  demonstrated  in  Figure  3.  It  is  important  to  note 
the  benefit  of  using  the  sole  source  cost  experience  as  a  basis  for 
comparison.  In  most  cases,  the  sole  source  cost  improvement  curve  is  derived 
from  better  data  (e.g  actual  costs)  than  any  other  parameter  considered. 
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Another  important  point  is  that  this  comparison  should  be  made  for  production 
after  the  quantity  at  which  the  second  source  is  fully  tooled  and  prepared  for 
head-to-head  competition.  Refering  to  Figure  3,  Q3  must  be  after  the 
quantities  for  the  qualification  and  directed  buys  have  been  added.  Finally, 
this  comparison  should  be  made  over  the  whole  range  of  Q3  to  Q4.  The  key 
parameter  is  calculated  in  the  following  expression. 

2=1-  TCc2  (3) 

BASCss 

Z  can  be  interpreted  as  the  average  percentage  difference  between  the  sole 
source  cost  experience  curve  and  thi1  deduced  cost  curve  for  the  second  source 
in  a  break-even  situation.  TCC2  has  been  calculated  and  is  portrayed  in 
Figure  3  with  an  assumed  slope  for  display  only.  A  value  for  TCc2  can  be 
obtained  directly  from  equation  (2)  without  any  slope  assumption.  Basess  is 
the  total  cost  associated  with  the  area  under  the  sole  source  cost  improvement 
curve  between  Q3  and  Q4.  So  2  represents  the  savings  the  government  will  have 
to  get  from  the  second  source  relative  to  the  sole  source  experience  given  the 
break-even  assumption. 

Our  experience  in  looking  at  a  half  a  dozen  dual  source  programs 
indicates  that  a  value  tf  7  of  or  less  shows  that  competition  is  likely  to 
produce  enough  savings  to  offset  the  up-front  costs  of  establishing  the  dual 
source  capability.  Values  of  2  greater  than  25S  indicate  that  competition  has 
only  a  slight  chance  of  break-even. 
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IMPLEMENTING  THE  BREAK-EVEN  APPROACH 


Implementing  the  recommended  approach  requires  the  resolution  of  three 
issues  Including  choosing  a  year  by  year  quantity  split  between  the 
competitors,  assessing  the  cost  impact  of  changes  in  the  annual  production 
rate  and  selecting  a  point  to  use  as  the  starting  quantity  for  competitor  2. 

In  the  following  paragraphs  each  of  the  essential  remaining  assumptions 
(share,  rate  effect,  and  range)  is  discussed.  It  is  Important  to  remember 
that  the  analyst  has  not  had  to  either  directly  or  Indirectly  make  a  point 
estimate  of  how  much  savings  will  result  from  competition. 

The  first  fundamental  assumption  embedded  in  the  analysis  is  the  decision 
on  how  to  split  the  annual  buys  between  the  competitors.  For  a  starting  point 
the  analyst  can  set  the  split  in  quantity  at  50:50  once  the  new  source  is 
fully  qualified.  This  choice  is  made  for  simplicity.  Of  course,  the  share 
ratio  should  be  set  at  a  different  value  if  there  is  some  indication  that  one 
competitor  will  have  a  consistent  competitive  advantage  over  the  other. 
Whatever  method  is  used,  the  analyst  should  test  the  sensitivity  of  this 
assumption  by  varying  the  share  ratio  later  in  the  analysis. 

The  second  basic  issue  the  analyst  must  address  is  how  to  account  for  the 
lower  production  rates  resulting  from  dual  source  production.  While  there  are 
many  methods  available,  we  have  selected  an  expression  which  is  directly 
related  to  the  underlying  fixed  and  variable  nature  of  production. 
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The  expression  we  use  is  as  follows: 


stable 

Fi  =  JLi _ 


new 

Qi 


x  K  +  (1  -  K) 


(4) 


Where 

i  *  Annual  lot  number. 

=  The  rate  adjustment  factor. 

stable 

Qi  =  The  lot  quantity  associated  with  expected  stable 

production  rate;  this  may  be  the  tooled  rate  for  some 
programs.  This  parameter  may  also  be  different  for 
each  of  the  dual  sources. 

new 

Qi  =>  The  lot  quantity  for  the  new  alternative. 

( 1  — K )  =  The  fixed  recurring  cost  factor  or  the  fraction  of  the 

recurring  procurement  costs  which  will  not  change  as 
quantity  changes  in  the  short  run. 


This  formula  can  be  directly  derived  from  recognizing  that  production 
costs  consist  of  both  fixed  and  variable  components  and  is  most  applicable  for 
continuous  assembly  manufacturing  processes  such  as  those  normally  found  in 
major  weapon  system  production  facilities.  Discussions  with  various 

contractors  suggest  that  K  (the  percent  of  total  recurring  costs  which  are 

*  ,  • 

fixed  in  any  year)  is  in  the  range  .10  to  .20.  The  analyst  can,  of  course, 
use  any  other  formulation  of  the  rate  effect  which  is  appropriate  for  a 
specific  program.  The  important  point  is  that  some  fore  of  appropriate 
penalty  for  lower  production  rates  must  be  included  in  the  analysis. 


The  third  basic  assumption  is  where  on  the  quantity  axis  of  the  cost 
curve  to  start  the  second  competitor.  This  is  only  required  for  the 
.calculation  of  Basess  later  in  the  evaluation  of  results  and  is  not  an 
estimate  c2  costs.  In  making  this  assumption,  the  analyst  must  make  a 
judgement  based  on  the  circumstances  of  the  program  being  examined.  In  some 
cases,  the  new  competitor  may  be  able  to  effectively  gain  the  full  learning 
benefits  of  the  original  supplier.  If  there  were  an  effective  technology 
transfer  program  or  a  leader/follower  contract,  the  second  source  competitor 
might  be  considered  as  starting  the  first  production  buy  at  the  same  quantity 
as  the  prime  contractor's  first  production  unit  (following  full  scale 
development).  There  are  also  cases  where  the  new  competitor  will  be  starting 
with  no  production  experience  on  the  system  and,  in  this  situation,  must  be 
assumed  to  start  at  unit  one  of  full  scale  development.  The  starting  point 
assumption  must  be  based  on  the  conditions  present  in  each  specific  program 
being  analyzed. 

The  last  point  to  consider  before  starting  the  actual  break  even 
calculation  is  the  treatment  of  system  engineering  and  program  management 
(SE/PM)  costs.  In  doing  this  analysis  it  is  desirable  to  treat  SE/PH  costs 
separately  from  hardware  production  cost.  Because  SE/PM  is  a  level  of  effort 
activity  more  dependent  on  program  maturity  than  annual  production  lot  size, 
it  is  more  accurately  treated  as  a  period  cost,  that  is,  it  is  essentially  a 
fixed  level  of  effort  independent  of  the  size  of  the  annual  procurement.  The 
analyst  must  also  be  careful  in  the  treatment  of  SE/PM  costs  because  of  the 
wide  variation  among  defense  contractors  in  the  definition  of  what  is  included 
in  this  cost  category. 


BREAK-EVEN  EXAMPLE 


Having  established  a  general  framework  and  discussed  a  number  of  the  key 
assumptions,  the  following  example  demonstrates  the  implementation.  Figure  4 
shows  an  example  of  a  weapon  system  whose  actual  recurring  development  and 
production  costs  are  shown  (the  +’s)  along  with  a  projection  of  these  points 
through  completion  of  the  procurement  program.  For  this  example  a  nominal 
production  rate  of  1000  missiles  per  year  and  a  fixed  recurring  cost  factor 
(K)  of  15  percent  were  used.  Competition  begins  with  the  third  production 
lot,  unit  2001  (see  Table  1),  and  the  sole  source  estimate  to  complete  is 
portrayed  by  the  solid  line  thereafter.  Note  that  the  curve  is  plotted  on  a 
linear-linear  graph  so  that  total  cost  is  proportional  to  area  under  the 
curve. 

Next  the  analyst  must  estimate  the  net  cost  of  investment  required  to 
establish  the  second  source  capability,  INVESTMENT  -  INVESTMENT^ 

(see  Table  2).  This  estimate  should  include  all  costs  the  Government  will 
incur  to  implement  competition  minus  any  investment  costs  required  to  continue 
with  the  sole  source  alternative.  These  might  include: 

-  costs  of  new  facilities  and  facility  alterations  (if  they  are 
dedicated  to  this  program); 

-  cost  of  general  and  special  tools  and  test  equipment; 

-  cost  of  qualif ication  models  and  qualification  testing; 

-  cost  of  technology  transfer  between  old  and  new  contractors; 

-  cost  of  data,  support,  schedule  v&pact  and  administrative  effort 
associated  with  competition. 
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In  addition  to  these  non-recurring  start-up  costs,  a  portion  of  the  cost 
of  any  directed  (i.e.  non-competitive)  initial  production  buys  from  the  new 
.source  «ust  be  included.  Directed  buys  may  occur  during  the  transition  period 
between  ?  sctr  source  situation  and  the  point  at  which  the  second  source  is 
fully  prepared  lor  competitive  production.  Unit  costs  during  directed  buys 
are  greater  than  costs  from  a  mature  production  facility  because  the 
capability  for  full  production  is  still  being  developed.  The  difference 
between  the  cost  of  these  units  from  the  second  source  and  what  the  same 
number  of  units  would  cost  from  the  sole  source  is  included  in  the  non¬ 
recurring  category  (because  they  occur  during  the  start-up  period). 

Next,  the  analyst  needs  to  estimate  a  unit  cost  curve  for  competitor  1, 
This  contractor  usually  has  an  extensive  basis  for  a  competitive  cost  bid  due 
to  development  and  production  experience.  However,  optimism  shown  in  this 
initial  bid  may  not  continue  in  later  bids.  Our  experience  indicates  that  the 
curve  for  competitor  1  is  likely  to  shift  downward  at  the  point  at  which 
viable  competition  begins.  This  shift  has  ranged  from  a  few  percent  to 
fifteen  percent  of  the  unit  cost  at  that  quantity.  In  addition,  the 
improvement  curve  slope  may  steepen  from  one  to  five  percent.  Our  basis  for 
these  figures  is  proprietary  data  from  several  programs  and  so  it  cannot  be 
quoted  here.  The  choice  on  a  particular  program  is  up  to  the  analyst's 
judgement  and  should  be  based  on  specific  program  information  (e.g.  contractor 
past  experience,  competition  results  similar  systems,  contractor  eagerness, 
viability  of  potential  competitors,  etc.).  An  example  of  a  cost  iaprovement 
curve  for  Competitor  1  is  shown  in  figure  4.  In  this  example  the  curve 
representing  competitor  1  s  shifted  10*  and  rotated  3*  from  the  sole  source 
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curve  at  the  point  competition  begins.  Other  combinations  of  shifts  and 
rotations  could  produce  the  same  total  for  competitor  1.  The  area  under  the 
.competitor  1  curve  provides  a  number  for  TCci  in  equation  (2). 

Given  the  required  inputs  for  equation  (2)  ,  the  deducrJ  break  even  cost 
for  Competitor  2  can  be  calculated.  This  calculation  m*r,<  performed  in 

present  value  terms.  First,  all  entries  are  converted  lo  the  present  year 
constant  dollars  (pure  constant  dollars  with  no  out!;y  inflation  included). 
Then  each  year's  entry  is  discounted  to  present  value  (DoD  accepted  practice 
is  10<  per  year).  Next,  equation  (2)  is  evaluated.  In  our  example,  TCSS  is 
S3494M.  TCcx is  $1608M,  and  the  net  investment  is  S254M  in  present  value  terms. 
At  this  point  in  the  analysis,  a  solution  for  TCc2  is  in  hand.  In  our 
example,  TCC2  is  S1632M  in  present  value  terms  and  is  displayed  in  figures  2-4 
as  the  shaded  area. 

For  a  comparison  with  the  corresponding  portion  of  the  sole  source  curve, 
TCc2  is  converted  from  present  value  to  constant  dollars.  This  calculation 
requires  the  assumption  of  a  slope  but  is  not  very  sensitive  to  variations  of 
♦10  degrees  of  slope.  In  most  cases  the  sole  source  slope  can  be  used. 

Referring  to  Figurr.  4,  consider  how  to  interpret  the  deduced  cost  for 
Competitor  2  {TCC2).  Remember,  the  deduced  cost,  TCC2,  is  the  tuaximun  cost 
which  can  be  associated  with  Competitor  2  and  still  allow  a  break-even 
financially  for  the  government  (i.e.  pay  the  bills  associated  with  setting  up 
competition).  To  determine  whether  competition  is  beneficial,  decision  makers 
must  determine  whether  the  break-even  cost  associated  with  Competitor  2  is 


achievable.  Several  criteria  are  listed  below  and  will  be  explained  using  the 
example. 


a.  First,  how  does  TCC2  compare  with  Basess?  Basess  is  the  total  cost 
associated  with  the  sole  source  cost  improvement  curve  over  the  same  quantity 
range  as  Competitor  2  (see  Figure  3).  This  portion  of  the  sole  source  curve 
reflects  the  sole  source  contractor's  actual  cost  experience  before 
competition.  This  curve  provides  an  important  basis  for  comparison  because  it 
involves  fewer  assumptions  than  a  comparison  with  the  total  sole  source  cost 
or  the  total  Competitor  1  cost.  Equation  (3)  shows  how  to  express  the 
comparison  between  TCC2  and  Base  ss  in  terms  of  percentage.  Our  experience 
indicates  a  value  of  25  percent  or  less  for  2  indicate  competition  is  a 
reasonable  alternative.  Values  greater  than  25  percent  indicate  competition 
is  questionable.  Values  approaching  or  exceeding  40  percent  indicate 
competition  is  an  unreasonable  approach.  The  example  shows  20<  which 
indicates  it  will  be  difficult  but  achievable  to  reach  a  break-even  situation. 

b.  Second,  what  impact  do  common  vendors  have  on  competition.  This 
factor  is  critical  on  some  programs.  I?  the  sole  source  prime  already  has 
dual  qualified  vendor  sources  f->  rose  or  all  of  the  “buy**  portion  of  unit 
cost,  it  is  not  reasonable  to  expect  the  second  source  (Competitior  2)  will 
obtain  significantly  better  prices  from  these  vendors  than  the  prime  source 
(Competitor  1)  has  achieved,  particularly  if  the  prime  has  developed  vigorous 
competition  among  the  vendors.  As  a  result,  the  portion  of  unit  cost 
associated  with  those  common  vendors  most  be  deducted  from  TCSS  and  TCcj. 

This  will  produce  a  new  solution  for  TCC2*  The  comparison  discussed  in  a. 
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should  be  recalculated.  In  the  example,  40  percent  of  the  unit  cost  is  common 
vendors.  Figure  5  shows  the  new  result  for  Z  is  28%.  This  indicates 
competition  is  only  marginal. 

c.  Third,  the  sensitivity  of  the  results  can  be  tested  by  varying  the 
values  specified  for  key  variables  and  observing  the  impact  on  the  results. 

For  example,  variations  could  be  introduced  in  the  total  quantity  to  be 
competitively  procured,  the  percent  fixed  cost  in  the  rate  adjustment  term,  or 
the  investment  over  the  range  of  any  uncertainity,  or  others.  Figure  6  shows 
the  result  if  the  quantity  is  reduced  by  25<.  The  resulting  required  shift  is 
33X.  This  indicates  competition  is  probably  not  reasonable  for  the  lower 
quantity. 

CONCLUSION 


The  0S0  CAI6  has  found  the  break-even  methodology  to  be  useful  in 
assessing  the  reasonableness  of  competition  alternatives  on  several  major 
weapon  systems.  Any  attempt  to  forecast  the  behavior  of  prime  contractors  in 
competition  requires  difficult  assumptions.  We  have  developed  confidence  in 
the  approach  described  in  this  paper  because  it  avoids  the  difficult 
assumptions  required  in  making  an  explicit  estimate  of  the  second  source's 
costs  in  competition. 
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EXAMPLE  WITH  FULL  QUANTITY 


Legend 

A  SOLE  SOURCE 

x  coMfrmom 

MHiH  m  m 


T*C, 


2000  MOO  4000  MOO  *000  7000  MOO  MOO  ttOOO 

CfetM'MfcMl 


EXAMPLE  WITH  FULL  QUANTITY 


9*11  S«U*CC  CMrt  OtfCft  TMC  (AM( 
QUAUTit  ¥  WTe«ML  . 


CO 

CM 

o 

© 

cH 

fH 

o 

o 

o 

o 

fH 

o 

fH 

o 

fH 

| 

o 

fH 

m 

o 

o 

CM 

fH 

o 

o 

o 

fH 

fH 

o 

o 

fH 

t 

i 

fH 

cn 

o 

o 

fH 

o 

o 

o 

fH 

fH 

o 

o 

c* 

1 

i 

fH 

CO 

o 

o 

o 

o 

o 

w 

ov 

o 

o 

CO 

t 

t 

fH 

fH. 

o 

o 

o 

o 

CTv 

00 

o 

o 

rv 

t 

i 

fH 

VO 

o 

o 

fH 

o 

o 

o 

00 

o 

o 

VO 

i 

fH 

in 

X 

a— 

o 

o 

f— * 

o 

o 

:* 

C>h 

VO 

o 

o 

i 

»H 

c 

k— 

|ta-4 

o 

o 

_i 

o 

o 

Q- 

VO 

in 

o 

o 

vn 

a 

CO 

o 

o 

o 

o 

CO 

o 

o 

in 

r* 

o 

m  o 

o 

o 

CM 

— * 

CO 

in 

a 

o 

*-* 

o 

o 

as 

O 

o 

C 

co 

in 

co 

CM  Q 

in 

o 

fH 

fH 

CM 

fu 

o 

o 

a. 

o 

o 

CO 

CM  *-• 

co 

co 

fH  O' 

o 

o 

w 

w* 

m 

tn 

*-%, 

o 

o 

CL 

o 

o 

CM 

CO 

m 

w 

o 

o 

o 

tn 

o 

© 

o 

u. 

CM 

CM 

UI 

> 


Ui 

»• 


3 

UI 

>- 


m 

I/I 


»  '  ■ 


© 


< 

_l 

r> 


5 


o 


M 

< 

*— 

SC 

© 

f 

< 

£ 

o 

© 

© 

© 

O 

JM 

CM 

CM 

o 

© 

o 

ui 

£ 

a. 

o 


UI 

Q 


«* 

u 

t/> 


u 


© 

© 

o 

o 

« 

a 

< 


H 


o 

s/I 


© 


H 

CD 

O 


V  tv  » 

•2.*-.  **,  i 


,  -  *<■  -.  *■«.»»»  -  >  *  a  ^ 
*  *  <•  °  %  '  -  •••  „  *  - 
r  »  •.  .  «  .  _  ». 


I/I  co 
CO  CO 


Ana  Hoiivoidnvnn 


NET  INVESTMENT  300 


